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ADOLESCENTS* ADULTS* MALES* OCCUPATIONAL CHOICE* TEST 
RELIABILITY* TEST VALIDITY* PICTURE INTEREST INVENTORY* 

A PICTURE INTEREST INVENTORY FOR THE DEAF WAS 
CONSTRUCTED AND STANDARDIZED. THE INVENTORY CONSISTED OF 27 
TRIADS OF LINE DRAWINGS REPRESENTING VARIOUS OCCUPATIONS. 

ITEMS WERE GROUPED INTO 10 SCALES— PERSUASIVE * CLERICAL* 
MECHANICAL* SCIENTIFIC* OUTDOOR* LITERARY* COMPUTATIONAL* 
ARTISTIC* SOCIAL SERVICE* AND DRAMATIC. SUBJECTS WERE DEAF 
MALES AGED 16 OR OVER AND WITH 10 SCORES ABOVE 85 BRAWN FROM 
RESIDENTIAL SCHOOLS FOR THE DEAF* BUREAUS OF VOCATIONAL 
REHABILITATION* PUBLIC SCHOOLS* GALLAUDET COLLEGE* AND THE 
EMPLOYED DEAF. AFTER 31/2 MONTHS* TESTS WERE REABMINI STEREO 
TO 1659 OF THE ORIGINAL 2590 SUBJECTS. RAW SCORES WERE 
CONVERTED TO STANDARD SCORES. INSPECTION SHOWED STABILITY OF 
MEANS ACROSS THE RANGE OF AGES INVOLVED. TEST-RETEST 
RELIABILITY COEFFICIENTS FOR FOUR OF THE SUBJECT GROUPS 
{EXCEPTING THE EMPLOYED) FOR EACH OF THE 10 SCALES WERE MADE. 
MEDIAN RELIABILITY COEFFICIENTS WERE .571 FOR RESIDENTIAL 
SCHOOLS* .602 FOR PUBLIC SCHOOLS* .649 FOR BUREAUS OF 
VOCATIONAL REHABILITATION* AND .733 FOR GALLAUDET COLLEGE. TO 
DETERMINE VALIDITY* SCALE SCORES OF THE GALLAUDET SAMPLE WERE 
CORRELATED WITH CORRESPONDING SCALES OF KUBER PREFERENCE 
RECORD. THE PRODUCT MOMENT COEFFICIENTS RANGED FROM .239 TO 
.612 WITH A MEDIAN OF .417. AS ANOTHER MEASURE OF VALIDITY, 

THE TEST WAS ADMINISTERED TO A SAMPLE OF EMPLOYED DEAF IN 22 
OCCUPATIONS. MEANS AND STANDARD DEVIATIONS ON EACH SCALE FOR 
THE 22 OCCUPATIONS WERE DERIVED. ALTHOUGH THE SCALES BID TEND 
TO DISCRIMINATE AMONG THE OCCUPATIONAL GROUPS* SOME SCALES 
DID MOT DISCRIMINATE IN THE EXPECTED DIRECTION. 
INTERCORRELATIONS WERE COMPUTED AMONG THE 10 SCALES ON THE 
SAMPLE GROUPS. A CONSIDERABLE AMOUNT OF OVERLAP IN WHAT IS 
f MEASURED BY EACH SCALE WAS NOTED. RELIABILITY OF THE 
DIFFERENCE BETWEEN SEPARATE SCALES YIELDS A RANGE OF .00 TO 
.79 WITH AN AVERAGE OF .56. NORMS IN T SCORE TERMS ARE GIVEN 
FOR ALL GRADES IN THE RESIDENTIAL AND PUBLIC SCHOOLS AND FOR 
15 OCCUPATIONAL GROUPS. TO DETERMINE THE CORRECTNESS OF 
PLACING ITEMS IN SCALES* A 61 SERIAL CORRELATION BETWEEN EACH 
ITEM ALTERNATIVE AMD EACH OF THE 10 SCALE SCORES WAS 
COMPUTED. NECESSARY STEPS TO MAKE THE TEST READY FOR 
OPERATIONAL USE ARE DESCRIBED. (FD 
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Introduction 



Counselors mrking with deaf clients have long been aware of the difficulties 
of appraising Interests with conventional measures* Many deaf people^ particularly 
those with little education^ suffer severe verbal handicaps* £b^erience has 
shown that interest profiles developed with conventional measures such as the 
Strong and the Kuder fjrequently do not correspond with claimed interests or with 
observed behaviors in the job selection process* Iwo reasons for this phenomenon 
are usually suggested: (1) Deaf people do not understand the language of the 

tests; and (2) Deaf people have a different set of life, experiences fjrom hearing 
people* £Ltber or both of these reas<ms for deviate interest patterns may be 
correct* Certainly it is known that some of the conventional interest measures 
require higher levels of reading ability than are atl^dned by most of the non- 
college deaf* It is reasonable to suppose also^ that the relative isolation 
imposed by deafhess might cause deaf persons to come into the testing situations 
with different sets of values than are held by typical hearing people* 

It was hypothesized that a test medium \Mch would obviate the language 
problems^ and idiieh would leave little room for individual intexpretation of 
content^ might overcome both of the difficulties mentioned* The cliche^ ”A 
picture is worth a thousand words” may be less than perfectly true^ but it was 
compelling to believe that pictures would acconplish both our aims* Pictures 
would make words unnecessa^ and they would provide a fairly faithful representa- 
tion of the object or situation pictured* Hctures would require a minimum of 
interpretation* Accordingly^ the project was initiated in the hope that deaf 
people might be helped to express their Interests more adequately; and that 
counselors might have an iaprcved tool with which to work* 
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This project was made possible, in part, by a grant provided by the IMted 
States Office of Vocadonal Heha'oilitation* 

This project was initiated on August 31, 195P^ under the direction of Stephen 
P* Quigley, Ph*D*, Gallaudet College* The Principal Investigator was Harold 
Geist, Ph.D*, Berkeley, California* On January 20, lp6l. Dr* Quigley resigned 
as Project Director a^ was replaced by Howard h, Koy, Ph*D*, Gallaudet 
College, who is responsible for structuring this report* Dr* Roy, in 
consultation with Dr* Fred Klein, Clinical Psychologist and Dr* Harry Bomstein, 
Research Psychologist, has attempted to present an objective account of the 
strengths and weaknesses of the research* The summary and conclusions 
represent a o<»uienstt8 of these members of the Gallaudet College faci;G.ty* 
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Purpose 



The purpose of this project vas td construct and siandardissji a pictorial 
inventory of vocational interests for USd «ith deaf males. The reason fox* under- 
taking this project Was the dearth of tests standardized exclusively on the deaf 
and used with the deaf. Ihe development of a picture inventory of interests for 
the deaf was motivated by a desire tiO overcome the obstacle to interest measure- 
ment imposed by the language handicap fran which so many deaf people suffer. The 
reading difficulty level of currently used interest inventor^Les makes many of 
them inapplicable to the deaf. The specific objectives of tliis project weret 



A. 

Bo 

C. 

X). 

E. 

P. 



To assemble an experimental pool of pictured interest itons in test 
form. 

To determine reactions of a wide range of deaf males to the experimental 
test. 

To detezmine 'Uie reliability of each of the separate scales of the 
test. 

To estimate the validity of the test. 

T6 develop norms for the interpretation of the test. 

To make available an tnstzoiment tdiich would assist the deaf in 
choosing suitable occupations and careers# 



Methodology 

The study was divided into two parts^ each part *toking ipxproadLmat^y one 
year. The first year was devoted tos 

A. Preparing the instrument. 

B. Selecting the samples for study. 

C# Inf orming the. participating organizations of the nature and purpose 
of the project. . 

D. Collecting data from all samples except one> the sm^^yed deaf sanple. 

The second year was devoted tot 

A. Collecting data fToa a samjAe of employed deaf males* 

B. Analyzing all data* 

C. Interpreting and reporting* 

r 

Sampling * 

It was hoped that the test resulting from this project would be applicable 
to that part of the mala deaf population likely to be choosing occupations in ^ch 
to work. Accordingly^ the stu^ was limited to deaf males age 16 or older Kdth 
I.Q.s above 8$. Samples were drawn fromi I 



20 residential schools for the deaf 
Bureaus of Vocational Rehabilitation (BTR) in 26 ftates. 
1 public schools 
Employed male deaf. 
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3/ The selection of residential scJwols was based on geographical location (the 
objective was to get a geographically representative distribution) and on the 
numbers and avaiuLability of s^jects for testing in each school. BVRs were 
also chosen on the basis of geographic representativoncss* Public schools 
were selected on the basis of a male census, i*e*, all publlo schools that had 
over 100 deaf ms^es were aeleoted for testi^* 
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Table I ahoi?s the msaber of persons tested inl’(d.al3y in each of tlie major 
groupings* After an interval of the same sauries were retested* Table 

2 indLoates the number of people Still in the saii^les at that ^e and retested* 
Although considerable attrition had Oddhil^ed^ it is b<\^Liefved that only the usual 
reasons for absence from school or work were operating:* No known seleotive factors 
were observed to make the retested samples different firom the initially tested 
samples* 

TABLE 1 



Numbers of people tested initially 
categorized by type of orga3»ization 





Ibitial Sso^le 


Residential Schools 


1029 


Bureaus of Vocational Rehabilitation 


897 


Public Bay Schools 


122 


Qallaudet Ck>llege 


123 




S7I 


TABLE 2 


A# 



Numbers of people retested in each category 
showing mean ages 



, 


FlnA 


Mean 






&mple 


Age 

• 




Residential School 


Sl»9 


13.1 




Bureaus of Vocational Rehabilitation 


h9U 


26.1 




Public Bay Schools 


96 


17.1 




Qallaudet College 


U6 


22.i( 




13S9 




» 



An effort was made to categorize the student samples by g:rade level* Inas* 
much as grade levels do not have the same meaning in «dl schools for the deaf, 
standings on school achievement tests were sometimes tused to estimate grade 
level* The results of this categorization are believed to prectent a reasonably 
accurate picture of distribution of students by grade* Table 3 shows the number 
of stodents tested at each grade level, in the secondary schools* 



Bie definition of deafness for the . purpose of this study was an ope^tional 
one* The subjects were peopie who had been adjoitted to schools fOF" the de^^ 
special classes for thb deaf in i^blid Schools or. to a college for the deafj • ^ *: 
clients of the State Bureaus of Vocational Re hab il i tation^ idiose eligibility for 
service was based on deafness^ and people idxose inclusion in a survey of deaf 
people was contingent upon their b^Jig'deaf# No audicnetxdo nieasures were 
applied but it is safe to say that these subjects think of thoaselwes as deaf^ 
participate in the activities of l^e deaf and for the most part were pMtaking of 
benefits intended for the deaf. In the case of ByR clients^ ”deaf " was defined as 
a 70 decibel loss in the speech fzequency rango^ 200 CPS to 2000 CPS. 



TABI£ 3 

Numbers of People Retested at Each Grade lev^ 
la the Residential Schools 



7th grade 




8th grade 


OltS 


9th grade 


157 


10th grade 


156 


nth grade 


• 132 


12th grade 


97 




85 


, vocational ^ 




} 


5!^ 



# Manual • People for fiiom the primary mode of ecnmunleation is 
^ Vocational - People enaroUed in vooatior^ training courses. 



Table k shows the regional distribution of the finfiOl samples. Table 5 
indicates the occupations of the people tested in the employed sample. The 
onployed deaf were identified throu^ a previous study, "Occupational Conditions 
Among the Deaf," y and letters were sent to approximately 2,000 of thpse 
individuals inviting th€dr participation. Of the 2,000, UOO could not be loc^d 
and 35 had died. Altogether about 700 failed to return the test materi^s. Thus 
the 931 tested represent about a 60% return firom the locatable, living, original 
sample of em^oyed deaf. 
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Dunde, Anders and Blgaian, Stanley, HOeoi;q>ational CouHtions Among the Deaf,"’ 
Gallaudet College, September 19S9* 






TABUS b 

Regional Distribution of Hsiel Sanqf^les 



Bureau Vocational 



Regions 


Residential Schools 


Public Schools 


Rehabilitation. 




No. of 


No. of 


Ho. of 


No. of 


No. of 


No. of 


t 


Subjects 


Schools 


Subjeoto 


Schools 


Subjects 


BTRs 


New England 


6U 


1 


6? 


3 


35 


U 

fs 


Middle Atlantic 


120 


3 


67 


3 


68 


9 

A 


East North Central 


180 


U 


2U 


2 


2U 


3 


West North Central 


98 


3 


5 


X 


hh 


6 


South Atlantic 


210 


7 






150 


21 


East South Central 


60 


1 






30 


5 


West South Central 


12U 


2 






65 


10 


Mountain 










23 


3 • 


Pacific 


93 


2 






57 


3 




w 


23 






E95 

« 
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$ASt£ 5 

Uumber of employc^d male deaf tested 
in each occupational group 



Printers 




Occupational Group 

Sales Workers^ Insurance Agents and Attorneys 

GOlerks ^ 

Pressmen uO 

Cos^ositors 1(3 

Zdnot^s Operators 17$ 

KLooxmen 22 

Phot 0 ©rip‘avers 17 • 

Miscellaneous 
_ printers 2$ 

Draftsmen 
Cabinet Makers and Carpenters 
Machinists 
Tool and Die Makers 
Misc^aneous Mech^eal 
Butchers and Bakers 

Medical and Dental Techidcians^ Chemists 
Science Teachers, and Natural Scientists 
Athletes and Athletic Coaches 
Famers 

Authors, Editors, Reporters, and librarians 

Accountants, BooWceepers, and IBM Operators 

Mathematics Teachers 

Artists and Art Teachers . ^ 

Clergymen 

Social Nblfare Wbrkers and Guidance Counselors 
Teachers - Aoademio Teachers 

- Vocational and Printing Teachers 
Actors and those interested in dramatics 
Entire Enployed Ocetq;)atienal Qto\xp 
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3hstrument Preparation 
!• Rationaile for item ejection* 

It was believed that if an individual ware shown a number of pictures^ each 
representing some ooc\ 9 ation or t^e of work^ and asked to choose the pictures 
he liked bestj he ifould thereby reveal his liking or disliking for the occiq;>ation8 
shown. In view of the fact that the test was intended for use with deaf pe^ple^ 
care was taken to represent those ooeiQ>ati^ in tdiich deafhese would not 
constitute a handicap* 

Thirty nine pictures were taken from the Geist Picture Interest Inventory* ^ 
An addition^ k2 lectures were drawn to represent occY^ations named in "The 
Survey of OocupaUonal Conditions Among the Deaf" mentioned above* 

A pilot stu^ was conducted on 120 daaf students at the C^ifomia School 

for the Oeaf^ Berkeley^ to ascertain the recognizabllity of the occupation or 

other activity portrayed by each of the pictures* Each individual was asked to 

indicate^ ihat he. thought wa& presented by ea^ picture* Their answers were 
compared with a key p^pared by the principal investigator. Since the test was 

as scientist^ it was counted as correct* This pilot stuchr accos^lished two 
objectives t a) It identified those pictures which were areoognized by the majority 
of the subjects^ and b) It furnished a base of information for deciding at what 
age and intelligence levels the test could be used* As a result of this pilot 
study^ three plotures were eliminated and three new ones meeting the criterion 
of 85 percent recognlzability were substituted* Those plotures not recognized 
by at least 85 percent of the group were eliminated^ leaving a total of 81 
pictures for arrangement in test form. As a result of the study* it was decided 
the test could be used with deaf maleli 16 years or older* with I.Q**s 85 and 
above and should be 2 restrieted to su^ people* 

2. Foxmat of the Test 

Three pictures, each judged to represent a different occupation or 
activity* were grouped as a triad. Twenty-seven such triads comprised the 
experimental test. Assignment of pictures to triads was dene a prio^* on the 
basis of expert judgment* Care was taken to insure that the pietureb groiped in 
a triad represented occupaitions of equal prestige and status* Items taken from 
the General Form of the Geist Picture Interest Inventory were already in triad 
foxmdt and their content was not changed* 

Items were presented as line drawings, on@ triad to each page of the test 
booklete Instructions to the examinee were: "On these pages are pictures of 
jobs or things you use in jobs* Look at the pictures on each page and decide upon 
one ,at which you would like to work...*PLck onHy one picture on each page." No 
time limit is set but the examinee is urged to work as fast as he can* The test 
can be administered to individuals or to groips* It requires a minimum of verbal 
instruction by the test adninistrator* 



H 



Geist Pictuaee Interest Inventory, pubUshad by Psyohologioal Test l^dalists* 
P*0. Box lUil* Klssoula* Montana 
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3. Scales Included 

Historically’ the iai have been dApioyed in relatively few occupations. 

It seemed desirable to tost idiether their intei*ests transcended this restricted 
rsng6# For this ro&son^ it was decided to attcropt to inestsure istereats in th© 
same areas covered by the Kuder Preference Record with the exception of the 
xQui^cal scale. A dramatics scale was included instead. 

Bjqperience with the Geist Picture Interest Inventory suggested groai^ 
the items into 10 scales. Items were assi^^ned to a given scale on the basis of 
^expert judgment." ^ Osseripbions of the soales are: 

Scale 1. Persuasive: Enjoys influencing people and likes to deal with peopj®? 

likes such activi.tiss as selling and promoting; likes those occupations 
and hobbies which call for inducing or urging people to take a certain 
course of action. 

• i 

Exan^les of occupations vMeb people idio score hig^ on the persuasive 
scale mi^t enter are: the (Aergy^ s ellin g^ law^ and teaching. 

Scale 2. Clerical: Idkes office work; likes to keep records, accounts, 
correspondence, and files. 

Examples of occupations tdiieh people who score hig^ on the dei^al 
scale nd^t enter are: bookkeeping,, filing, shipping and receiving, 
stock, siqoply and inventory, billing, banking, mail order and postal 
office work, office machine operation and typing. 

Scale 3. Mechanical: Ehjoys using manual skills and likes working with or 
repairing tools or machines. 

t 

Examjdes of occupations >rtiich people who score high on the mechanica l 
scale xaay consider' are: Printing, mechanics, sheet metd work, 
making, upholstering, mechanical asssmbly work, wdding, blacksmi thing, 
steel furnace work, carpentry and watch repair. 

« 

Scale k» Scientific: likes to acquire knowledge or to discover new facts and 
ideas: interested in knowing the how and why of things, particularly 
in the natural sciences. . 

In this groi;^ are dassified those whose interests are pidbaarily in the 
physical and biological sciences rather than the behavioral sciences. 

• Most of the o^upations characteriaed by interests in this field are » 
professional. 

# 

Examples of occupations ihich people idio score high In this area idght 
consider arei Chendstry, bacteridogy, meteorology, nuclear physics, 
and astronomy. 




§/ 



Judges were: .1^. B.K. Strong, Jr., Harold Carter, and Dr. Hardd Oeist 
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Scale 5* 



Scale 6* 



Scale 7« 



Scale 8. 



Outdoor: Prefer^ activities in the open air. 

Exantples of liitcupatiLhftS score hi^ in this area night 

consider arei Physical education, coaching, farming, telephone line 
repair, truck driving, fishing, surveying, and delivery work* 

Literary: Likes to read books and other forms of writing end may like 

to write. 

Examples of occ.^pations in this area are: editing, reporting, English” 

and foreign language teaching. 

Computational: Likes to perform numerical calculations; enjoys estisast* 

ing, counting, enumerating or figuring. 

The following kinds of activities are included in the computational 
areas; r^^counting and auditing, drafting and cartograpl^, ell kinds of 
engineering, mathematics, bookkeeping, barking. 

Artistic: Likes to do creative work himself and enjoys beauty in other 
people's work; interested in the esthetic aspects of life. 

Suggested activities for people who score hi^ on this scale are: painting^ 
drawing, sculpture, photography, commercial art, and cartooning. 



Scale 9. Social Service: Likes to help others; enjoys promoting and participating 
in social welfare activities such as the assistance of the sick, 
destitute or unfortunate. 

Examples of such activities are: clergy, guidance and counselors, social 

welfare work, probation work and recreation. 

Scale 10. Dramatic: Likes acting or other activities closely connected with the 

cinema or the theatre. 

Examples of such activities are: acting roles in plays or movies, 

puppetry, and pantomime. 

Some alternatives were judged to be Indicative of interest in more than one 
area, hence certain items appeared in more than one scale. Table 6 indicates the 
ntimber of alternatives in each scale which were also keyed in other scales. There is, 
as would be expected, much more overlap between some scales than others, e.g.. Scale 
1 overlaps considerably with Scale 9 and not at all with Scale 3. 

A serious weakness of the test, inherent in its construction, must be 
pointed up at this time. While each of the triads included pictures representing 
three specific and different occupational activities, it is apparent that sometimes 
more than one of the activities represented in a triad belonged to the same 
occupational area. Triad number 7, for example, presents pictures of: (1) a man 

painting walls, (2) a man operating a floor polishing machine and (3) a man shaping 
a piece of metal on an anvil. Judging that each of these activities belonged to the 
larger occupational area usually described as "mechanical,** the test constructors 
keyed all three alternatives for Scale 3, Mechanical. Hence, no matter which 
alternative the test taker chooses ne must, perforce, earn one point on Scale 3. 
Obviously the item has no powe.^ to discriminate. The extent to which this type of 
construction and/or keying error occurred in the test is partially revealed, by 
Table 6a which shows maximum and minimum scores for each of the scales. 
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TABLE 6 



ku^et^ of 1 , 
^ One 6t 




Scale 

1 Persuasive 

2 Clerical 

3 Mechanical 
U Scientific 

^ Outdoor 

6 Literary 

7 CcsQputational 

8 Artistic 

9 Social Service 
10 Dramatic 



2 

1 



0 

2 



1 

0 

2 



4h |Abh Scsle 
Aa^tdthai Scales 



r* 



1 

0 

h 

1 



1 

2 

0 

0 

0 



2 

0 

2 

h 

1 

0 



8 

0 

0 

1$ 

0 

1 

0 

1 



6 

0 

0 

1 

1 

1 

1 

0 



10 

1 

0 

0 

0 

0 . 

1 

0 

0 

1 



TABLE 6a 

Mscdmum and Minimum Scores for the Seales 
of the Picture Interest Inventory 



Scale 

1 
2 
3 
U 

s 

6 

7 



Maximum 
Score Possible 



Minimum 
Score Possible 



Persuasive 


7 


0 


Clerical 


7 


0 


Mechanical 


16 


3 


Scientific 


9 


1 


Outdoor 


11 


0 


Literary 


5 


0 


Computational 


7 


1 


Artistic 


20 


0 


Social Service 


6 


0 


Dramatic 


3 


0 



Number of ^^tems 
Potentially Capable 

of Discriminating 

•7 

7 

13 
. 8 
11 

5 ‘ 

6 
20 
6 
3 



In some instances the discrimination power of the items was not reduced to 
zero^ but was partially reduced by the keying of two of the three alternatives in 
a triad. This kind of keying makes the triad a two alternative iton instead of 
a *thr86 altemal/ive Itsm* Table 6b shows the nurobes? of triads in each seele having 
one> two or three alternatives k^ed. 

©le occurrence of the same keyed alternative in more than one Scale^ as 
mentioned above, and the reduction in discriminative power of some of the items by 
the method just described is particularly unfortunate in this instance, since 
there wre so few items to begin with. An attempt to measure Interests in ten 



occi^ational areas would seem to have demanded noire than d 27 iten pool ot 
untried experimental items* It would |^hve heen., wiser, to dttao^t the derelo p n e n t 
of one or two sealeS if 27 itoos jllLl that doi^ld bd found* 



TABLE 6b 

Numbers of Items in Each Scale Having 
Qne^ Two or Three Keyed Alternatives 



Scale 


One Keyed 


. . TwoEeyed 


Three Keyed 


1 Persuasive 


7 


0 


0 


2 dezlcal 


7 


0 


0 


3 Mechanical 


5 


8 


3 


^ Scientific 


7 - 


1 


1 


$ Outdoor 


11 


0 


0 


6 literary 


5 


0 - 


0 


7 Computational 


6 


0 


1 


8 Artistic 


17 


3 


0 


9 Social Service 


6 


0 


0 


id Dramatic 


3 


0 


0 



j 

I 

Data Collection 

* ( ■• 

f 

1* Securing cooperation 

I 



Letters explaining the project were sent to the Superintendents of the 
residential schools selected for testing* The letter asked each school to name 
a person who would be responsible for administering the test* Upon receipt of 
these names> Dr* Geist^ PxrindLpal Investigator^ sent detailed instructions to 
e^ch responsible person* 

In the case of the Bureaus of Vocational Rehabilitation^ an initial letter 
e^laining the project was sent by the Principal Investigator to all OVR regional 
chiefs and BVR State directors who^ in turn, relayed the information to the 
district managers of the BVR*s* The district managers named responsible persons 
to idiom the Pzlncipal Investigator sent letters explaining the method of 
administering the test and the testing materials* 



A personal letter, signed by the President of Gallaudet College, was sent 
to each person in the employed deaf sample* This letter ex^ained the project, 
stressed its importance and urged active participation in it* The Principal 
Investigator sent a letter giving instructions for taking the test, together with 
the. necessary materials and an addressed stamped envelope* 



Three mionths after the original testing, the Principal Investigator sent 
directions for retesting at the saiae locations* Cepiw of this oorresp<mdenoe 
are shown in Appendix C* 










2. Testing 

The locally named person, in the case of schools and 
test and forwarded the answer sheets to the Princip^ 
o£ the eji 5 >le 7 e(l deaf sanple, test nateritals wre shipped 

*0 took the test by themselws and rettirned ti»ir ansser sheets to the Principal 
Investigator* 

Three months after the initial testing of the resi&n^ schools tmd l^ 
the tests were returned to the cooperating agencies and administered a second 

•time* 

Data Analysis 
.1. Scoring * 

Scoring consisted of detemdnisg the nuaber of times the 
belongine to a given scale# were selected ly the examinee. To facilitate con 
''arisen and intwpretation, raw scores were converted to standard sccres irtth an 
»bitrary mean of^SO and a S.D. of 10 (T-soores). Distributions wwe oht^d 
for the residential schools (grade 8-12), oral and manual, tallau*t 

schools, deaf male clients of the State Bureaus of Vocational Retol^ta- 
tion and for each of 15 occupational groups. These distributions are shojn in 

Appendix A, Tables 10 tiirou^ 35. 

A word of caution should be said here regarding 

it also makes the size of the difference bet^ the various 

than real. For example, a brief look at Table 10 in Appendix A will show toat 

1 raw score point is equal to 6 T-score points on Scrie 1, to ^ 

on Seale 2, to 9 T-seore points on Scale 6 and to 16 T-score points on Sorie 1 . 

la o^ wSrds, an inadvertent choosing of an alternative not 

-h=»'e- the subject's position on <he norms from h^ a sta^d deriatim ^ 

li atandard deriations. Counselors accustomed 

form are quite likely to think of such position ®f, ®^snifi^b^ 

meaningful. It must be admitted here that they have little meaning 

purp 088 s of coiHisoUng* 



Si. 



Statistics Obtained. 



•A. KeliabiUty. Test-retest (34 months) cautions were detoxed for 

aU samples except the employed deaf. The product mcment method of 
correlstion was used for Ibis purpose. 

B. Means, otandard deviations and intercorrelations were computed for 
all samples. 

c. Correlation of each alternative with each of the 1® ®^®®‘ *^® 

analvsis was performed to obtain information regarding the extent to 
S ea<Trite^Ltive "belonged" in the scale to which it was assigned 

a priori. 

D. Product moment correlations were determined betwen J**^*^^ 

• of the Pietbre Interest Siventory «®d.c<OTe8pondlii« scaUs of^ Kuder 
Preference Record. This sfcalyaiB was p^otmed cn the Oallaudent 

* Wing was done at the Oakland CaUtowU Public SchwXs s^ all 

was done at the Computer Center, Radiation l.aboratory, Unlv. C U .» y 
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Resiilta# 

A. Keans ^d StandaH OeviaU^ 

T&bie 7 shows means and standard deviations for residential schools^ 
public schools^ Bureaus of Vocational Behabilitationi Qallaudet Collage and for 
the employed deaf sample. Inspection of Table 7 reveals stability of means 
across the range of ages involved. This seems to suggest that there is relatively 
little change in interests within the age range represented by the progression 
f^om secondary school to job, ■ 

B. Reliability 

Table 7 shows the test-retest reliability coefficients for: residential 
schools^ public schools^ Bureaus of Vocational Rehabilitation and for the Gallaudet 
College samples for each of tlie ten scales. The median reliability coefficient 
for ?11 ten scales is also presented. Inspection of this table suggests a 
greater consistency for college students than for secondary school and rehabilita- 
tion client samples* The reli^ility coefficients for the College sample average 
approximately ,1 hii^er than that for the other samples. These higher odofficients 
may result from a greater maturity on the part of the college students, In ary 
event, the reliability indices are fairly high in all samples. In this respect, 
they conv)are favorably with other interest measures in current use, 7 / More 
information regarding the reliability of the instnmient is presented in Table 37, 
Appendix B, 

C. Validily 

In constructing the present measure, an effoarfe was made to ’’build” validity 
into the test. Items were selected for inclusion in a scale because they were 
recognized by the majority of subjects (and judges) as belonging to a given 
occupation* we only assuii^tion involved in this approach was that ^iien a 
subject was asked to choose the picture he liked best, he woid.d thereby reveal 
an interest in the occupation represented by the pictured alternative. It is true 
that this procedure results in a high degree of “face validity and brings wxw 
it both advantages and disadvantages. On the advantage side is the observed fact 
that people generally respond more enthusiastically to items which they can 
recognize and imderstand. On the disadvantage side is the fact that, by including 
only "face valid” items, one must necessarily exclude other items not so obviously 
related to the criterion, but more highly correlated with it, A concomitant of 
this point is that we learn little about the test taker that could not be learned 
by simply asking him what job he would like, 

I 

0 

Two efforts were made to demonstrate the validity of the Picture Interest 
I&iventorys correlation of scores obtained with those obtained on another test 
purporting to measure the same thing and con^arlson of scores earned on the 
different scales by people ^ployed in different occupations* 



7/ Traaier and McCall report test-retest areliabilitles for the original seven 
scales of the Kuder to be ,78 based on a sample of 52 college students over 
a two months interval* The finding for Gallaudet College is almost i^ntioal 

being ,73* 


















XU. 



As a check oil 'tiie Picture Intei^Ust Xnventoxy* the scale scores obtained on 
the GaUaudst College san^le nbi?d. bd|li?dXdted tsite scores oh corresponding 
scales of the Kuder ^reference Record* The results of this analysis are shows in 
Thble 9e 
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TABLB 9 



Product«Hcment Correlations of Qoist Piotmcv Intea^st Inventorjr 
Per Deaf with Kuder Seales 



- -3 



Qallaudet San^le 



a 
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Coxresponding Kiader Scalds..' 
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Per 


Qer 
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Sc 
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Ut 


Comp 


Art 


SoSer 


U6 


.259 


.bOti 


.1|17 


.612 


. .398 


.525 


.bio 


.539 


.5U 



Median Ul7 



Within the limits of this study* there appears to be a fair3y close 
relationship between the two tests {only nine scales are coiapaxed, as t^ mu^cal 
scfide of the Kuder was not conwion to any scale of the Picture Interest Ihv^toiy}# 
Coefficients range ITom *26 to .61 with a median of .U2. Table ‘9 shows this 
relationship in tenns of product mwnent correlation coefficients. 



A second means of demonstrating , the validity of the scales involved the 
adninistering of the test to a sample of employed deaf people in 22 deferent 
occupations. It was hypothesized that people working in any given job wo^d score 
higher on the scale purporting to tap interests in that job than they would on 
other scales in the test. Table Appendix A shows the means and standard 
deviations on each of the scales for all 22 occupations. 



Inspection of Table 39 suggests that the scales do tend to disciiminate 
among the various occupational groups represented. If one considers the raw 
score meai^ in reference to the total possible score for each scale^ it will be 
seen that in most instances an occupational group has its hipest score on the 
scale which iseasures interests in that occupation and higher scores on its 
pertinent scales than do other occupational groups. Or to put it another way^ 
mechanics have higher mean scores on Scale 3 than clerical workers. Ttos is not 
always true^ however, e.g», academic teachers have a higher Dramatics Sc^e mean 
than actors. The difference in raw score points between the means for clerks and 
machinists on the Mechanical Scale is only .6. Butchers and bakers have the same 
mean on the Artistic Interest Seale as artists and utt teaches. Accountants, 
bookkeepers and lEM operators have lower mean scores on the Clerical Scale than 
clergymen, social welfare workers, teachers, actors and athletic coaches. 
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The failTjre of gome of the soaleg to (kgoiitslhate ih the expected direction 

cteq)eriinehtal effoi^, A more serious concerned raised by this 
part of the analysis is the lack of practical significance of the differences 
between the me^s for the great majority of the occupations tested. In many 
^toces the difference between the mean score for an occupational groim on a 
fffr® P®3^inQnt to it and the mean score of other occi^tional groups on the same 
is or two raw score points with standard deviations of 1.0 or 

means of occupational groups are so close, the 

overlap so much as to make the instrument most 
Reliable for the guidance of any one individual. It should be remembered, 

however, that this is the result of a first eacperimental rm of the test. The 
'encouraging finding is that in general the differences between occupational gr*^ upg 
are in the e:q>ected direction. This is an indicatic^ii of seme progress and a 
s^gestion that continued development in the same way may yield an instrument to 
aid the counselor and the client in decision making. 

D. Ihtercorrelation. 

To determine the extent to vhich the scales were actually measuring something 
different, intercorrelations were computed among the 10 scales on the different 
samjO.es. The results of these computations are shown in Tables 38 through k$ in 
Appendix B. &spection of the tables reveals a considsrable amount of overlap in 
jtot is being measured by the separate scales. In all eight samples the r 
between Scale 1 and Scale 6 is •> or above. The same is true for the relationship 
between &a2es 1 and 9, and in seven of the eight samples, and is true also for ths 
correlation between Scales 1 and 10. Ih all eight samples, Seales 2 sad 6 are 
^terrelated to the extent of .5 or greater. 

A correlation of .9 between Scale 1 and Scale 9 will be noted. The 
e^l^ation for it is readily apparent when it is known that 'ttie two scales are 
identical except for one item. Scale 1 has seven items. Scale 9 has six. ftn 
^t v»ae of the keyed alternatives in Scale 1 are common to the six keyed alterna«» 
tives in Scale 6. Obviously, no <£Llnical use could be made of the separate 
scoring and interpretation of these scales. The fact of this almost con^lete 
overlap is a commentart on the rational construotion of scoring keys and points 
the need for empiribal testing of "judgment’' keys. 

t 

While many of the scales are highly intercorrelated some are not. Some 
j s approach zero and some are negative. Because of the small numbers of items 
^ the scales, each time an item appeared in more than one scale it contributed 
^eavily to the intercorrelation between the scales involved. 

Mien the scales of a test are scored and interpreted separately, it is i 
Implied that each scale represents a different factor. actual practice, we .. 
generally find (as is the case here) considerable Intercorrelation between the 
scores obtained on the different scales. When this intercorrelation is hi^, 
the researcher is obliged to show that the differential score patterns obtained 
do not occur through errors of measurement only. It is necessary, therefore, to 
consider the reliability of the differences obtained between the separate scales 
of the test. GuUicksen ^ discusses this question and describes a method for 
estimating the reliability of the differences between two sub-test scores. 



^ . 14 * 



6/ GuUicksen, Harold, Hi»ry of Ifental leata, John Wiey & Sons. Ina. 
.New. York, ISjOs Pp 3«a -355. # » w 
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vheTQ their, intercorx^diti'^oll and the. reLiabilltg^, of each is knotm* App3i.cati.on 
of this method to the present sltuamon reveals that the rollabili^ of the ^ 
difference .between the separate scales range from «00 to **19 with an average t .. 
of .56* This finding, ^diile not dLsconraging, suggests the need for caution in 
assuming the observed differences to be real* 

F* Nonas* 

Norms in T score terms are presented for all grades in the residential and 
public schools, BVRs, Gallaudet College, and for l5 selected occiq^ational groins* 
Admittedly the Picture Interest Inventory has not proceeded far enou^ in its 
developmaat to justify the use of these norms for personnel selection or for 
counseling. Comment was mad© earlier about the problem of interpretation and the 
reader is cautioned again that the use of standard scores with arbitrary means 
of $0 and S.D*»s of 10 make patterns or profile difference appear significant 
when, in fact, they may not be* The T-score dLstributions would lead the counselor 
astray if he were to assume that the difference between a T-score of 2il and a T« 
score of 55 is meaningful tdien in fact it is only the difference betweai a raw 
score of 1 and a raw score of 3» Yet, lil is almost a standard dsvlation below 
the mean and 55 is half a .S*D* above the mean* 

The justification for conversion to T-soores is adii^ly that it makes reading 
and comparability easier* 

0* Integrity of Scales* 

It will be remonbered that the scales were assembled on the basis of expert 
judgment* Each item alternative was considered by the judges and assigned to one 
of the scales because it seemed to belong to "Uie area measured by that scale* 

In order to determine whether the item alternative assigned to a particular scale • 
••belonged!? to it,: and also to find tiiether items not assigned to. a given scale 
should have been included, an item-scale score correlation was run for each of the 
8l item alternatives* That is, the biserial correlation between each item 
alternative and each of the 10 scale scores was computed* Table U6, Appendix B 
shows the results of this analysis* Unfortunately, the very small number of 
items in sane of the scales nullifies much of the value of this type of analysis 
and makes it inappropriate for all except Scales 3,U»5 sxid 8* Wiere a scale 
contains fewer than 10 items, the correlation of any one item with the total 
scale score means that the correlation of that item with itself €Wscounts for a 
large part of the total correlation found* testing the significance of 
correlation obtained under these conditions one cannot simply determine whether 
the coefficienji. is significantly different from zero* He must test >diether the 
amount of correlation remaining after that due to the item vs itself is removed, 
is significantly different from zero* A method for making this test is described 
by Guilford. 9/ Applying this method to the data in Table U6, it will be seen 



9/ Guilford, J.P., Fundamental Statistics in Psychology and Bdueation, 
KcCk'aw-Hill B^k Gcxapany £ao*. New fork, 1956* Pp 326 * 328* 
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that statistical evidence for the items belonging in the scales to idil^ they „ 
were assigned is lacking in a large number of oases* Ihe numbers of item 
alternatives which appear to have been properly assigned range ftnra one for Scale 
10 to 12 for Scale 3* 



Summary and Conclusions 

!• Because large numbers of deaf people are sufficiently handicapped in 
communication to make conventional interest measures not feasible^ an effort was 
made to dev^op an interest inventory with a mixiimum of verbal content* 

2e An 63 q)erimental pool of 27 pictured interest items in triad form was 
administered to male students in residential schools^ and in speolel classes for 
the deaf in public schools^ male clients of Bureaus of Vocational Rehabilita* 
tion, male students at Gallaudet College and to a sample of employed deaf males* 
The purpose of giving the test to the school students and to the BVR clients was 
to obtain information about feasibility of the measure and to determine its 
reliability* The objectives in testing college students and employed people were 
to obtain evidence of validity* 

3* The test met acceptable standards of reliability test-retest method* 
Evidence of validity is less encouraging. No criterion data were available for 
the school people and none were collected from the BVR people* Correlations with 
the Kuder Preference Record range from *26 to *6l* Some evidence of validity 
was found in the differential scores of people employed itu different occupations) 
however, many of these differences were neither statistically nor practically 
significant and the average reliability of the differences between scales was not 
high* 

!;• Intercorrelation coefficients indioate a significant amount of overlap in 
the variance tapped by the separate scales* Some of tiiis intercorrelation is 
accounted for by actual overlap of items* 



To permit ease of reading and comparabili'ty, scale scores were converted to 
T-scores with an arbitrary mean of $0 and a S*D* of 10* 






0 ^ 

*>• 



6* An it®m scale score correlation analysis was performed to find how well the 
items of a given scale clustered* The results of this analysis are indeterminate, 
however, because of the small numbers of items in some of the scales* 

7* %e es^erimental test appears to bo understandable by a wide range of ages, 
and levels of intelligence* There is, however, a real question whether it is 
not too transparent to yield infoxmation not readily ascertainable by other means* 

8* This study has demonstrated that pictorial items are useable with deaf 
people* The test directions are understandable and deaf people have no unusual 
difficulty in dealing with the problem situation presented by the pictures* 



1^ Ifofortunately, five of the alternatives meeting the satisfactory significance 
level occurred in the xujn-disoriminating it^ne, i*e*^ those in whioh all three 
alternatives are punched thereby forci^ the subject to obtain e point no 
matter how he responds* 








la, 

9* The findings in the studir^ boik positive and negative^ ar@ si^t greatly 
different frcm idiat is e:q)ected in the first tryout of a pool Of is 

regrettable that the total experimental pool contained so few itais* ^vlded 
among the ten soales^ the number of items in ar^ ona scale is so small as to 
permit coverage of only a limited part of the criterion variance, and ^ihsn tha 
test is validated against an independent criterion, it is hlgh3^ likely that um® 
of these few items will be found not valid* ' 

10* It is the opinion of the writer that the Picture Interest Inventory has 
not been sufficiently developed and tested to warrant its use in a clinical 
situation* ]hi order to make the test ready ^ov operational use, sever£d steps 
are necessary: 

a* The number of items in each scale of the experimental test must be 
increased so that after the noxmal attrition incurred in the 
validation pz*oees8 has taken place, there will still ranain a 
' sufficient number of items to px^ovide stable predictors of a 
meaningful criterion* 

b* The foannat of the test should be changed to permit more use of 

each item alternative* For exeaz^le, ttie item alternatives might be 
regrouped to permit compazdson with a wide range of alternates, a 
la Kuder* 

c* After the it©a pool is increased, it should be tried out again in a 
situation in which criterion data can be obtained* Keys constructed 
on the basis of this tryout should be or^ss*validated on a part of 
the oample reserved for that purpose in a second r*un on an 
Independent sample* 

Qhe development of a test to measure interests in deaf people must follow 
the same steps as are followed in developing similar measures for hearing 
people ~ item construction, tryout, moclflcation, validation and cross- 
validation. Vlth both hearing and deaf people, thiu process takes a long time* 
VEth deaf people it is likely to be especially long because of the difficulty 
of finding sizeable samples of people with similar backgroimds and to whom the 
same sets of criteria idll apply* Thexre are no shortcuts* THob present research 
has accomplished a necessary first step, albeit a short one* There is much more 
to be accomplished before the over-all objective of this effort is acetmplished 
yiz*, to put an instrument in the hands of counselors which idll h^p them and 
their counselees in the difficult task of vocational choice making* 
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APPEKDH A 



T-Seore Conversions for 
Bureaus of Vocational RehaWlitation Clients 
Residential and PiO>lio School Students 
College Students and for People in the B89>loyad Sang>les 




T-SCORES FOR BUREMJS OF VOCATIONAL REHABILITATION 
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S36 


-259 . 


5 


j 








^8 


CXL7 


-390 


176 


•OI 16 


6 












ft 

CM 

I 


-12b 


hSU 


363 


0 

7 














-119 


-3hS 


-2U( 


. 8 
















-26U 


-HI 


, 9 


N • 100 
















532 


10 
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T«Ale Uk 








• 






BTERCOSREUTIOHS - 


VmL IIECHANIGAL 




• 


• 


Scale 1 


2 


3 

/ 


u 


S 


6 


7 


8. 


9 


10 



1 


. 199 


-132 


CM 


155 


b69 


-150 


-219 


937 


532 


2 




-ZL7 


Old 


- 16 U 


552 


093 . 


-311 


106 


068 


3 


. 




03l» 


120 


-332 


151 


Ido 


^)88 


-061 


h 






: 


136 


•ChO 


Z12 


-Ud 


-lt30 


-212 ; 


5 ■ 










-017 


05l 


-303 


176 


022 


6 


♦ 

s 










-235 


-lli5 


1»25 


360 


7 














-0tt9 


—268 


-193 


8 












* 




—20b 


-150 


9 


N - 275 
















50 b 



10 
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Scale 1 


2 


3 


k 


5 


6 


7 


8 


9 


10 


1 


301 


•*286 


- So $ 


183 


509 


—226 


-192 


91*1 


51*6 


2 




-li62 


009 


-170 


666 


-077 


-31*0 


220 


150 


3 






-107 


02l( 


-539 


120 


360 


-196 


-160 


h 








020 


-088 


2b2 


-292 


-5U 


—288 


j 

5 












09J» 


-389 


199 


-081 


6 












-355 


-167 


1*65 


1*53 


7 














-121 


“31*8 


-21*1* 


8 
















-177 


-Ola 
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Congelations Betveen Each Item Alternative 
Each oi the Ten Scale Scores 



I, 



t 



I 



ITEM 

i. 

2 

3 

4 

5 

6 

7 

8 
9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 
21 
22 

23 

24 

25 

26 

27 

28 

29 

30 

31 

32 

33 

34 

35 . 

36 

37 

38 

39 

40 

41 

42 



CAUAUDBT COt4<E6E STODENIS 
H * 118 



Mote: Circled itexn 

are those that are 
eeored on each scale. 




032 
294 
-.058 
.000 
.059 
-.278 
-.058 
-.287 
-.647 
• .083 

.008 

.083 

-.099 

.010 

.111 

-.088 

.103 

-.118 

.050 

.045 

.008 

-.040 

.131 

-.274 

.087 

-.119 

-.494 

C-64D 

: i 67 

.037 

-.166 

-.026 

.191 

-.114 

-.025 

.189 

-.145 





8 



10 




* -023 
-.280 

:C35 

.089 

-.144 

-.153 

-.096 

-.200 

-.274 

.139 

.189 

-.067 

-«299 

».275 

.053 

.167 

-.223 

-.012 

.111 

-.067 

.079 

—.088 

.029 

.088 

.002 

-.065 

.021 

-.137 

.085 

.065 

-.258 

.231 

.100 

.063 

-.147 

.006 

.080 

-.062 

-.215 

-.009 

-.220 



-.124 

-.072 

:303 

.090 

-.145 

.084 

-454 

.002 

.136 

-.309 

.128 

.231 

-.019 

.090 

<474> 

-.330 

-.144 

.054 

.106 

.228 

-.201 

-.078 

-.020 

-.006 

.020 

.033 

-.159 

.090 

.117 

-.224 

.152 

428 

-.036 

-.054 

-.017 

.121 

-.071 

-.126 

.082 

.051 
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Correlations Between Each Itea 
Alternative and Each of the Ten Scale Scores 



r ite m M 



43 

44 

45 

46 

47 

48 

49 

50 



51 
I 52 

5 3 

54 

I 55 
f 56 
I '57 
I 58 

I 60 
^ .61 
t; 62 
I 63 
I 64 
i 65 
i 66 
^ 67 
68 
^ 69 
i 70 
f 71 
^ 72 
^ 73 
' 74 
^ 75 
; 76 
77 
= 78 

i 79 
i SO 
; 81 



■V 



^ '4 




i ^ 

\ eric 



5 



8 



10 



-^n 

.0 X 7 

.064 



-•iZi 

-.rar 

«*.004 

.075 




.040 

.028 

-.152 

.399 

.223 

-.541 

.018 

.079 

.026 

-.174 

.017 

-.169 




.OAO 


-.159 


.233 


/. OOJ ^; 


-.018 


.074 


.171 


-.108 


K 3 X 3 


.023 


-.114 


.045 


-.192 


:270 


.002 


.062 


- o 059 


.113 




-.029 


.051 


-.008 


.012 




-.001 


-.101 


.053 


-.098 




023 


-.041 


-.105 




-.072 


- o 333 


.085 


.272 


-.442 


.034 




-.057 


-.207 


-.008 


.033 


-.439 


-.004 


.083 


-.097 




.017 


-.290 

i -343> 


-.051 

-.024 


.026 

.067 




-.022 

.008 




-.100 


.114 


-.505 


.068 


-.497 


.030 


-.075 




-.099 


-.051 


.161 


-.096 




.062 


-.047 


-.615 




-.126 


-.229 


.131 


-.199 


-, l 49 


-.043 


.100 


-.031 


•;740 


•!.540 


-.102 


.173 


.298 


"“.033" 


-.194 


-.075 


.161 


-.118 


.144 


-.136 


.093 


.137 


-.217 


-.129 


.258 


.019 


-.228 



(.035? -.182 
-.427 .272 

-.124 
-. OT 3 T 3 .102 



.051 

-.047 

-.Oil 

-.215 



-.155 

-. QQ 9 

6Q27- 

-.018 

.034 

.152 

.118 

-.092 

-.189 

-.310 



-.087 
.004 
-.634 
rSS7j . 
r297 ^ 
'^58 
-.025 
-.050 

QW 

-.545 

-.133 



-.289 

6^5’^) 

-.292' 

-.017 

.022 

-.001 

-.422 

rMD 

- V 015 

.024 

-.027 

.005 



-.344 

-.073 

•363 

.280 

.178 

-.347 

-.112 

.114 

-.029 

.138 

-.043 

-.133 

-.027 

.041 

-.008 

-.253 

<.6 i § :^ 

.437 




.010 

.060 



-.054 



-.217 

.006 



-.562 

.052 



- t 206 



-.144 

-.120 

.022 

{1610 \ 



-.173 

.120 

-.038 

-.156 

-. iS 4 

•010 

/• 



223 ; 



-.581 

-.229 

1 X 30 ' 
-.070 
-.023 
-.253 
:.425 j ? 
r:295 
>*:65 l ! 
-.'346 
-.473 
-.145 
• 138 
.046 

.'.757> 



-.278 



-.091 
•085 
.037 
•106 
.012 
-.093 
-.177 
.410 
-.295 
.072 
-.053 
-.010 
- 171 

-.224 
-.044 
c 254 
.024 
-.205 
-.135 
-.326 
-.092 
-.360 
.034 
•Oil 
-.033 
-.092 
.143 
-.092 
.232 
-.105 
-.189 
-.192 
.089 
-.161 
-.456 1 
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